PageRank Algorithm Applied To the Food Web 94
An anonymous reader brings word of a new application for PageRank, Google's link analysis algorithm: monitoring the food web in an ecosystem. A team of researchers found that a modified version of PageRank can predict with great accuracy which species are vital to the existence of others. Quoting:
"Every species is embedded in a complex network of relationships with others. A single extinction can cascade into the loss of seemingly unrelated species. Investigating when this might happen using more conventional methods is complicated, as even in simple ecosystems, the number of combinations exceeds the number of atoms in the universe. So, it would be impossible to try them all. Co-author Dr. Stefano Allesina realized he could apply PageRank to the problem when he stumbled across an article in a journal of applied mathematics describing the Google algorithm. 'First of all, we had to reverse the definition of the algorithm. In PageRank, a web page is important if important pages point to it. In our approach, a species is important if it points to important species.'"
Why is this surprising? (Score:4, Interesting)
Pagerank is just a repeated application of a transformation matrix. It has the effect of running a Markov model (a way to model discrete states) until there is convergence. He just used a Markov model the way that it is supposed to be used...
I dont get it... what's notable here?
Re: (Score:3, Funny)
I dont get it... what's notable here?
We're finally able to figure out what species will have the most impact if it is removed. Likely, the folks at google are turning this into some sort of biological warfare device - They want to figure out which species of mosquito we have to kill in order to remove all mouth-breathers from the planet, leaving all the hot women alive for the rest of us.
More seriously, if we can figure out which species are most important (and which are least important), doesn't that give both the tree-hugging sea-kittens a
Re: (Score:2)
Likely, the folks at google are turning this into some sort of biological warfare device - They want to figure out which species of mosquito we have to kill in order to remove all mouth-breathers from the planet, leaving all the hot women alive for the rest of us.
Hey, hey, what's with all this "us" stuff?
Re:Why is this surprising? (Score:5, Funny)
It's remarkable because a biologist discovered math and possibly statistics.
Re: (Score:2, Funny)
Actually the Markov model is prevalent in bioinformatics, as well as other statistical methods. However, the biologists are an entirely different race, typically unfamiliar with advanced mathematics. In fact, the entire field of biology works on foundations and culture so alien to science (fondness for objectivity and modesty) sometimes I wonder whether it is right to call them scientists, or just group them with the social scientists and psychologists.
It's a pity they dominate the big science journals.
Re: (Score:2)
In fairness to biologists, their science has only recently (compared to other sciences) become a "hard" science with strong foundational theories and strongly determinant principles that could be applied to arrive at a conclusion. Largely, it still is in the fuzzy region between the hard sciences (like physics and astronomy) and the social sciences (like anthropology and psychology). I've even seen biologists use anthropological tools and study methods when investigating animal behavior, to give an exampl
Re: (Score:2)
Excuse the screwup I just had with the above section. Firefox just re-located a sentence I had intended for the last paragraph that ended up in the first one. Oops.
Re: (Score:2)
Re: (Score:3, Informative)
Mathematical biology has a history that goes back further than computer science. Many biologists probably know a lot more math and statistics than your average computer scientists.
Re: (Score:2)
On the other hand, I've seen biologist written perl code [oxfordjournals.org] that terminated on div-by-zero, and closed, re-opened then seeked into the input file rather than implement a linear processing of data. I've also met plenty of biology grad students who basically said their technique for analysis was to invite a statistics co-author. If you're going to claim Mendel as a mathematical biologist, we might as well call Babbage a computer scientist, and he built the diffrence engine 30 years before Mendel's pea experiment
Re: (Score:1)
Not to mention SEO and PR... he must be reapplying for funding soon!
Re:Why is this surprising? (Score:5, Informative)
Re:Why is this surprising? (Score:5, Insightful)
For me, this tells me that perhaps these researchers should wander over to their local mathematics department more often. They might find all sorts of goodies that mathematicians have developed in the past few centuries. Dr. Allesina might have discovered that there was no need to reverse engineer the algorithm, since the underlying mathematical principles have been well understood for over a hundred years. We might have a better understanding of the world if most sciences took mathematical models as seriously as physicists do.
Re: (Score:2)
It would be good if these biologists who are impressed with this example were to read a book about Markov processes, or took a postgraduate course in stochastic processes. This isn't rocket science, it's quite commonly used by engineers, phy
Re: (Score:2)
Less sarcastically, I am not surprised a biologist is unaware of such mathematical models. It's notable for the fact that they're applying a rather simple method to a rather old problem and it's extremely effective.
Re: (Score:1)
Re: (Score:2)
Because it's an improvement of the old eBay feedback system biologists were using before. They found that system was open to "retribution" feedback if the prey didn't rate the predator highly enough.
Review by vole:
(positive) Fox was an excellent predator!!!! Would be eaten again!!!!! A+++++++++++!!!!!
More than atoms in the universe? (Score:3, Interesting)
Re: (Score:2, Interesting)
Yeah, I would tend to call BS on that particular statistic. Let's say the average water bottle is .5L. In that one, single water bottle that is sitting on my desk, there are 5.01*10^25 atoms. That's one hell of a number.
Now, let's pretend God has a really good magnifying glass and a really small set of tweezers, and he's removing atoms from this water bottle at a rate of 1 per second. Conservative estimates put the universe at 13.5 billion years old, which converts to 4.25*10^17 seconds.
So, since the
Re:More than atoms in the universe? (Score:4, Informative)
What does your tweezers and removing atoms have to do with combinations? It is trivial to come up with a situation where there are more possible combinations that atoms of the universe. The number of possible chess games starts to get close (magnitude of 50 versus 80 for the atoms in the universe. Slightly more complex scenarios would easily go past 10^80. The trick is to find a way to model the complexity with a much simpler algorithm.
Re: (Score:2)
How about raising 1 to the power of 80!. Yeah, that is going to be a really massive number.
Re: (Score:2)
Re: (Score:3, Informative)
Here ya go [wordpress.com]. About 59.
Re: (Score:1, Informative)
According to Wikipedia, [wikipedia.org] our best estimate of the number of atoms in the universe is 10^80. The smallest factorial greater than this number is 59! = 138 683 118 545 689 835 737 939 019 720 389 406 345 902 876 772 687 432 540 821 294 940 160 000 000 000 000 = 1.39 * 10^80. (The next smallest factorial is 58! = 2 350 561 331 282 878 571 829 474 910 515 074 683 828 862 318 181 142 924 420 699 914 240 000 000 000 000 = 2.35 * 10^78.)
Bioinformatic Algorithm for Standard Americans (Score:1, Funny)
A species is more important if it points to my stomach.
Also see my upcoming research topic:
Bioinformatic Algorithm for Standard Texan-Americans with Retro-Dissonant Suppositions
I expect to prove that BASTARDS are essential to the American way of life.
Re: (Score:2)
Especially if it points using a very sharp spear, or a shotgun. Then you can really talk about extinction and things "vital to the existence".
Re: (Score:2)
Re: (Score:2)
I'm guessing you've never watched 'Silent Running', but given what you said you might wanna start your re-education with another old movie: 'Soylent Green'.
As long as the world is this overpopulated we'll always have enough food. Cannibals aren't bad people, they're just pragmatic.
Re: (Score:2, Interesting)
Re: (Score:3, Insightful)
If you're under 40 and in good health you're in for a rather rude awakening, with those beliefs. You'll likely live to see the shit begin to hit the fan in a serious way. Google and other online sources should be education enough for you. I'm too disorganized to do anything more than plant the seed; you'll have to water and feed it.
Re: (Score:3, Interesting)
Re: (Score:2)
Living is more than not starving.
Re: (Score:2)
I'm guessing you've never watched 'Silent Running', but given what you said you might wanna start your re-education with another old movie: 'Soylent Green'.
I think you need to re-educate yourself with another movie: The Omega Man. If that's where we'll end up anyways, who cares how we get there? Eat drink and be merry, I say. Isn't there some movie about people being brainwashed with media and living in a world that isn't real (but they think it is) because they're too plugged into modern cu
Re: (Score:2)
Re: (Score:2)
Seriously, "so long as we have enough food and oxygen, all is good" ? Where the fuck does that food come from, idiot ? What processes combine to create that food ? Which lifeforms are necessary to provide those processes ? Which out of the millions of bacteria is it safe to eliminate before we are unable to digest food at all ?
I suppose you think fossil fuels are good because they are effectively free, all you have to do is dig them up. And that is relevant, as without fossi
Re: (Score:2)
Guess who actually got modded as Troll, though? Nope, not the "idiot"... it was my original comment pointing out the larger context being ignored (for the sake of TOFA). Modded as Troll not just once, but repeatedly.
If there's one thing about Slashdot that should change, it's the removal of anonymity when people moderate.
Re: (Score:1, Offtopic)
Problem is, a lot of companies point to companies that point to the MPAA.
Such a model may rate the MPAA and RIAA as higher ranked than the biggest single companies around.
Who could submit this article anonymously? (Score:2)
And why?
Re: (Score:2)
And why?
Sergey Brin. The nefariousness is obvious isn't it?
Importance (Score:3, Interesting)
In PageRank, a web page is important if important pages point to it. In our approach, a species is important if it points to important species.'"
The difference is, its pretty obvious to a human if a page is important. On the other hand there are a lot of species that we don't know if they are important or not. So how do we know what the "important" species are? Other than humans, we don't know of any real "important" species. Could the ecosystem survive without X? Theres no way we can really know that.
Importance is easy to determine... (Score:3, Funny)
It just isn't a good idea to experiment.
Re: (Score:2, Troll)
Re: (Score:2)
Its these things that will make the PageRank algorithm useless in biology.
I suppose you're right. Since you disagree, the entire idea must be without merit.
Re:Importance (Score:4, Informative)
Re: (Score:3, Insightful)
I was worried about this. Either underspecifying "importance" or using it in a simplistic way (though you may not actually be doing these things).
It measures a kind of importance. Not importance in all respects. Specifically, it measures importance in interdependence. Which only very roughly translates to an idealized general or universal importance.
Remove humans from the web and you won't get much "impact on [the] ecosystem" (in the form of cascading die off). Yet humans are generally regarded as "imp
Re: (Score:2)
If pandas go extinct, what effect would it have on the ecosystem? Almost none. It eats bamboo for 99% of its diet and I doubt it eats enough to be a source of control on the growth of bamboo. However, pandas are
Re: (Score:2)
The plumage comment was a joke, sorry. I was trying to be ludicrously shallow, but the truth is that beauty actually does count for something.
The value of life is not simple, so it's not easy to put it simply. For example, it's not clear to me what "good for the ecosystem" means. It sounds like maybe it means "tendency to preserve the extent (quantity?) of food/consumer relationships" or maybe "tendency to preserve maximal living mass" or maybe "tendency to promote diversity". This is real philosophical
PigeonRank (Score:3, Funny)
Re:Importance (Score:5, Informative)
NO! Page Rank is not named after webPage. It's named after Larry Page who created it. Arrrgh.
http://en.wikipedia.org/wiki/PageRank
http://en.wikipedia.org/wiki/Larry_Page
Re: (Score:2)
NO! Page Rank is not named after webPage. It's named after Larry Page who created it. Arrrgh.
http://en.wikipedia.org/wiki/PageRank [wikipedia.org]
http://en.wikipedia.org/wiki/Larry_Page [wikipedia.org]
I thought Larry Page was named after WebPage? No?
Re: (Score:2)
Huh -- I never realized poor Sergey Brin got screwed on that deal.
Very helpful for Endangered Species Act (Score:3, Interesting)
Or... (Score:2)
My proof?
Wal-mart (and the associated industries that support low prices).
Sure, save the whales/sharks/pandas/worms. But I better get my tampico for 0.34$/bottle and jeans for $4.99 so I can afford to help out.
Re: (Score:2)
Re: (Score:3, Insightful)
Re: (Score:2)
Do you have a point? Or did you just use the mention of the term "Pagerank" to come in here and randomly slag off Google?
Re: (Score:1)
Do you have a point? Or did you just use the mention of the term "Pagerank" to come in here and randomly slag off Google?
The poster has a point, and is certainly not slagging off Google.
The point is that the mathematics of Page Rank is not very deep. A fact which can be asserted.
Re: (Score:2)
<eyeroll />
Ok, Captain Expert. Pagerank is awful, and that's why Google is not useful to anyone. And these people trying to apply it to what organisms eat other organisms -- not, as you seem to think, to what restaurants are better than others -- is completely moronic as well, since the quality of the organisms' meals are more important than what organisms depend on what other organisms and to what extent, which these poor mislead people are paying attention to.
In short, gosh, I guess I'm the troll
Re: (Score:1)
I'd expect McDonald's to be ranked very high based on importance to the diets of people around the world while the importance of, say, filet mignon to be comparatively negligible. There are times where a popularity contest works: "Hey, people are getting fat. What food should we make healthier? Well, people seem to be eating a lot of hamburgers, so lets see if we can make those leaner!"
Re: (Score:2)
Re: (Score:2)
I would imagine that the many places Pagerank has found application would c
Re: (Score:2)
The *only* thing worthy of note with PageRank is the humongous size of the graph that is being modeled. This could never have been attempted until the 1990's because computers weren't powerful enough before (and the few that were just weren't going to be used for "silly" things like web search).
This begs the question (Score:1)
Re: (Score:1)
"Begging the question" is more like circular reasoning - you assume that which you are trying to demonstrate.
Eigenvector Centrality Measure (Score:3, Insightful)
The pagerank algorithm is better understood as a kind of Eigenvector Centrality Measure.
See http://en.wikipedia.org/wiki/Eigenvector_centrality#Eigenvector_centrality [wikipedia.org]
Meaning it is not new as a method by itself, but applying it to the linking-structure of the WWW in order to produce
relevant documents for a query, was new. I think it is fair to say that the Google Pagerank matters very little, outside of being able to rank otherwise
not-comparable search results.
And so it is better to state that "a specialized Eigenvector Centrality Measure can predict with great accuracy which species are vital to the existence of others" instead of "a modified version of PageRank can predict with great accuracy which species are vital to the existence of others". One can see that also when one realizes that these biologists have no query, no search, no equivalent of search keywords.
On the other hand, when the post says "Co-author Dr. Stefano Allesina realized he could apply PageRank to the problem when he stumbled across an article in a journal of applied mathematics describing the Google algorithm." -- I guess he might have found the method through the Google name.
Stephan
Useful (Score:2)
Awesome, now we know which species we can let go extinct!
Other utility (Score:1)
Gaia (Score:1)
Let me get this staight (Score:2)
How long do I have to point at a certain page to put it on top of Google search results.
So what happens when... (Score:1)